2. Image Enhancement 


The aim of image enhancement is to improve the interpretability 
or perception of information in images for human viewers, or to 
provide better input for other automated image processing 
techniques. Image enhancement techniques can be divided into 
two broad categories: 


= Spatial domain methods, which operate directly on pixels, and 
= Frequency domain methods, which operate on the Fourier 
transform of an image. 


* Chapter 3 (Image Enhancement in the Spatial Domain) 


* Section 6.3 (Pseudocolor Image Processing) 


Gray Level Transformations: Negative 


L-1 


= Image Negative: reverse 
the brightness from “black” 
to “white”. Useful in 


displaying medical images. 
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FIGURE 3.4 

(a) Original 
digital 
mammogram. 

(b) Negative 
image obtained 
using the negative 
transformation in 
Eq. (3.2-1). 
(Courtesy of G.E. 
Medical Systems.) 


Gray Level Transformation 
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Gray Level Transformations: 
Dynamic Range Compression 


Processing images exceeding the display capability s = c log(1+ |r|) 
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FIGURE 3.5 

(a) Fourier 
spectrum. 

(b) Result of 
applying the log 
transformation 
given in 

Eq. (3.2-2) with 
c= 1. 


Image Enhancement by 
Gray Level Transformations 


FIGURE 3.3 Some 
basic gray-level 
transformation 
functions used for 
image 
enhancement. 
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Gray Level Transformations: 
Power-Law Transforms 


FIGURE 3.6 Plots 
of the equation 

s = cr” for 
various values of 
y (c = Limal 


cases). 
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Gray Level Transformations: 
Power-Law Transforms 
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FIGURE 3.9 

(a) Aerial image. 
(b)-(d) Results of 
applying the 
transformation in 
Eq. (3.2-3) with 

c = land 

y = 3.0, 4.0, and 
5.0, respectively. 
Orignal mage 
for this example 


courtesy of 
NASA.) 
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— FIGURE 3.8 
(a) Magnetic 
resonance 
image (MRI) of a 
fractured human 
spine. 
(b)-(d) Results of 
applying the 
transformation in 


Ea. (3.2-3) with 
c = 1 and 


y = 0.6, 0.4, and 
0.3, respectively. 
Original image 
courtesy of Dr. 
David R. Pickens, 
Department of 
Radiology and 
Radiological 
Sciences, 
Vanderbilt 
University 
Medical Center.) 


Gamma Correction on Monitors 
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FIGURE 3.7 

(a) Linear-wedge 
gray-scale image. 
(b) Response of 
monitor to linear 
wedge. 

(c) Gamma- 
corrected wedge. 
(d) Output of 
monitor. 
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FIGURE 6.35 Tonal corrections for flat, light (high key), and dark (low key) color images. Adjusting the red, 
green, and blue components equally does not alter the image hues. 


CMYK Color System 


= Cyan (255,0,0), Magenta (0,255,0), Yellow 
(0,0,255), Red (0,255,255), Green (255,0,255), 
Blue (255,255,0), etc. 

= A practical variant, CMYK (with K standing 
for “black”, is spawned to provide an 
inexpensive ink. It is called 4-color printing. 
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PRIMARY AND SECONDARY COLORS 
OF LIGHT AND PIGMENT 


(assume all color values have been 
normalized to the range [0,1]) 


FIGURE 6.36 Color balancing corrections for CMYK 
color images. 


Color 
Balancing 
Corrections 
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Color 
Images 
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Gray Level Transformations: 
Contrast Stretching 


It is normally = v^ 
controlled bya =, 
L/4 


. A special case LA L2 3LA L-1 
e Input gray level, r 
is the 


ab 
eid 


FIGURE 3.10 
Contrast 
stretching. 

(a) Form of 
transformation 
function. (b) A 
low-contrast 
image. (c) Result 
of contrast 
stretching. 

(d) Result of 
thresholding. 
(Original image 
courtesy of 

Dr. Roger Heady, 
Research School 
of Biological 
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Contrast Stretching 


or 
T(r)=5B(r-a)+y, 
y(r—b)+y, 


a =50,b =150,a =0.2, B = 2,y 21, y, 230, y, = 200 13 


Image Intensity Clipping 


0 O<r<a 
T(r) =) B(r-a) a<r<b 
b(r-a) b<r<L 


a=50,b=150,8=2 15 


Point Processing: Gray-Level Slicing 


a) display a “high value” for gray levels of interest and a low value for others, 
b) brighten the desired range of gray levels but preserve the background. 


Original | Processed with (a) 


Point Processing: Bit-Plane Slicing 


= It highlights the contributions made to the 
total image appearance by specific bits. 
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FIGURE 3.13 An 8-bit fractal image. (A fractal is an image generated from n 
expressions). (Courtesy of Ms. Melissa D. Binde, Swarthmore College, Swart 


Point 
Processing: 
Bit-Plane 


Slicing 


FIGURE 3.14 The eight bit planes of the image in Fig. 3.13. The number at the bottom, 
right of each image identifies the bit plane. 


Point Processing: Bit-Plane Slicing 
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FIGURE 3.14 (a) An 8-bit gray-scale image of size 500 X 1192 pixels. (b) through (i) Bit planes 1 through 8, 
with bit plane 1 corresponding to the least significant bit. Each bit plane is a binary image. 


Combining Bitplanes 


— cad 


eee EEE mS Kiem 
Ait H , ISEO GC “A n x Pile GN 
© e iai A ii 
pr Led 
«TESTES. o A£571581294 e 
EEEk A vw 100] |. Aes 
BONE EX ND BER I9 frank e aO NENE ERE Pro 


AE571u81294 
ES 
EA ER 
te E 


a bé 


FIGURE 3.15 Images reconstructed using (a) bit planes 8 and 7; (b) bit planes 8, 7, and 6; and (c) bit planes 8, 
7,6, and 5. Compare (c) with Fig. 3.14(a). 
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Sheing plane 


Pseudo- 
Color 
Image 
Processing: 
Intensity 
Slicing 


(Black! o 
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Figure Jd.4N Geometric Inrerpreratron of Ure infensify-slicing technique 


Pseudo-Color 
Image Processing: 
Intensity Slicing 


What is a Histogram’? 


In Statistics, Histogram is a graphical 
representation showing a visual impression of the 
distribution of data. 


An Image Histogram is a type of histogram that 
acts as a graphical representation of the 
lightness/color distribution in a digital image. It 
plots the number of pixels for each value (bin). 


The histogram of a digital image with gray levels 
in the range /0, L-1] is a discrete function h(r,) = 
n,, where r,is the k-th gray level and n, is the 
number of pixels in the image having gray level r,. 


Histogram Processing 


The number of bins can be smaller than the number 
of gray levels, e.g., every 4 levels form one bin (256 
gray levels, 64 bins). 


It is common practice to normalize a histogram by 
dividing each of its values by the total number of 
pixels in the image, denoted by n. Thus, a 
normalized histogram is given by p(r,) = n,/n, for k 
=0, 1, ..., L -I. 

Thus, p(r,) gives an estimate of the probability of 
density (occurrence) of gray level r,. Note that the 
sum of all components of a normalized histogram is 
equal to 1. 


Histogram & Probability of Density 


MATLAB 
imhist(x) 


100 150 200 
Vk ny Pr(ri) = ng/MN 
nm = 0 790 0.19 
Zz n=1 1023 0.25 
n=2 850 0.21 for an M-by-N 
n=3 656 0.16 . 
n-4 39 0.08 (64x64) image 
r5 = 5 245 0.06 À 
re = 6 122 0.03 SIZE 
n-7 81 0.02 


Image 
Histogram 


Histograms of 
different kinds 
of images 


Dark image 


Hright image 


Lenv-contrast image 


High-contrast Image 


Histogram Equalization (HE) 


Basic idea: find a map T(r) such that the 
histogram (probability of density, pdf) of the 
modified (equalized) image 1s flat (uniform). 
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FIGURE 3.18 (a) An arbitrary PDF. (b) Result of applying the transformation in 


Eq. (3.3-4) to all intensity levels, r. The resulting intensities, s, have a uniform PDF, 
independently of the form of the PDF of the r's. 
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Histogram Equalization (HE) 


Key motivation: cumulative probability 
function (cdf) of a random variable 
approximates a uniform distribution 


Suppose Pr(k) is the histogram (pdf) 


O<T(r)<l, O<r<l 
OxT (ssl 0<s<1 


s=T(r)= Y Pit 


Histogram Equalization 


Let oe = Br. Az rz p()isthe probability 
dr density function. 


Thenls = T(r) = IN Drei leien 


d 
ds —T (s) ds p, (r) 


=> p.(s)—l, O<s<l 


For digital images, r, is discrete: 
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Histogram Equalization - Example 
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FIGURE 3.19 Illustration of histogram equalization of a 3-bit (8 intensity levels) image. (a) Original 
histogram. (b) Transformation function. (c) Equalized histogram. 
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An Example of Histogram Equalization 
with N=64, 0 <=r <= 15 
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One More Example 
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FIGURE 3.19 Illustration of histogram equalization of a 3-bit (8 intensity levels) image. (a) Original 
histogram. (b) Transformation function. (c) Equalized histogram. 


Histogram Equalization (HE) for 
Contrast Stretching 
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Another HE Example 


3000 


3000 
ft 
before SE | 2500 | er 

Z000 ES) 

1500 | 1500 L 
1000 + 1000 
500 | 500 
0 0 


9 50 100 150 200 0 50 100 150 200 250 300 36 


un 
N 
A 


Number of pixels ( x 10*) 
d 


0 64 128 192 255 
Gray level 


ab 


FIGURE 3.20 (a) Image of the Mars moon Photos taken by NASA’s Mars Global 
Surveyor. (b) Histogram. (Original image courtesy of NASA.) 
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FIGURE 3.21 

(a) Transformation 
function for 
histogram 
equalization. 

(b) Histogram- 
equalized image 
(note the washed- 
out appearance). 
(c) Histogram 

of (b). 


Histogram Specification 


Histogram equalization tries to generate a uniform 
histogram. 


For interactive image enhancement, the user may 
like to result in a customized histogram. 


---> Use Histogram Specification 


Histogram Specification 


An image with pixel values r is to be transformed into an 
image with a specified histogram. Denote the pixel values 
of the new image as u. Using histogram equalization, we 
can equalize the original and the desired image to an image 
with pixel values s with uniform histogram: 


Cs)= T(r) = i pico jdo 
Ge G(u)= pure lde 
u LG J= G "amp 


e Specify a particular probability density function p(u) 


=> G(u) => calculate G’ T for Histogram Specification. 


An Example of Histogram Specification 
with N=64, 0 <=r <= 15 
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^ An Example of Histogram Specification 
with N=64, 0 «2r <= I5 


"r 
o r)x64 
T(r)x64 
u 
B u)x64 
G(u)x64 
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u=G“T(r))x15 
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Output Intensity 


An Example of Histogram Specification 
with N=64, 0 <=r <= 15 (cot.) 


u=G (T(r) 
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FIGURE 3.22 = 
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histogram. E 3.50 
(b) Curve (1) is 5 | 
from Eq. (3.3-14), 5 : 
using the @ 17 
histogram in (a); 7 
curve (2) was 0 ELM zd Ts 
obtained using 0 64 128 192 255 
the iterative Gray level 
procedure in 
Eq. (3.3-17). 


(c) Enhanced 
image using 
mappings from 
curve (2). 

(d) Histogram 
of (c). 


Output gray levels 
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Example of Input gray levels 
Histogram 
Specification 
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Another Example of Histogram Specification 
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FIGURE 3.22 
(a) Histogram of a 
3-bit image. (b) 
Specified 
histogram. 

z, (c) Transformation 

D = function obtained 
from the specified 
histogram. 
(d) Result of 
performing 
histogram 
specification. 

. Compare 

“(b) and (d). 
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Example of Histogram Specification 
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Histogram Equalization for Color Picture 


To apply HE to an RGB color image: 


1. Convert RGB to dd (or HSI/HSY) 


2. Apply HE to the Y (or I/V) component 
3. Convert back to RGB 


Y 0.299 0.587 0.114 R 
U Eu -0.147 -0.289 0.436 G 
V 0.615 -0.515 -0.100 B 
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ble to do local 


Global vs. Local Equalization 
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Local Enhancement 


f(x,y) g(x,y) 


» Using a 
sliding window 
" of 15x15 pixels 


a(xy) = AG SC, y) 2 m(x, y) | + moy) 


where A(x,y)= K M , 0<K<l1 
O(x, y) 
Ain < A(x, y) € Aa 


m(x, y): local mean in the window centered at (x, y) 


O (X, y) :local standard deviation 
M : global mean 
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Image Averaging 


A noisy image y(n,,n,) is created by adding noise d(n,,n,) 
to an original image x(n,,n,), 1.e., 


y(n m) = x(n n,)+d(n n) 
where d( ) is uncorrelated and has zero mean. 


By averaging a set of noisy images, it is possible to 
reduce the noise effect. 


a ] É 
Ymen» = mena. 
i=1 


laan, a Al x, n). 


Image Averaging 


Ymen) =n n)+4 nny) 


The new noise d ( n: n) has a smaller variance 
(still zero mean), Le: 


Noise 
Reduction by 
Image 
Averaging 


(a) noisy picture 
(b)-(f): averaging 
2, 8, 16, 32, and 
128 different noisy 

images 


* Translation, scaling, 


Affine Transform | ~ a b elx ` . 
direte d filly rotation, shearing, 
| o 0 1l1 reflection, ... 

Scaling 
d —2 

e AO x a O Ollx 
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J= ES |y -|0 d 0| y 
] O O 1141 
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Rotation 7 mE ALS Ox 


x cosy -siny O| x eh 
y -|siy cosy Oy NI 
| 0 0 151 y 


These operators can be cascaded by matrix multiplications. 53 


